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Based on a generalized one-band Hubbard model, we study magnetic properties of Mott insulating 
states for ultracold spin-| fermionic atoms in optical lattices. When the s-wave scattering lengths 
for the total spin S = 2, satisfy conditions 02 > ao > 0, we apply a functional integral approach 
to the half filled case, where the spin-quadrupole fluctuations dominate. On a 2D square lattice, 
the saddle point solution yields a staggered spin-quadrupole ordering at zero temperature with 
symmetry breaking from SO (5) to SO (4). Both spin and spin-quadrupole static structure factors are 
calculated, displaying highly anisotropic spin antiferromagnetic fluctuations and antiferroquadrupole 
long-range correlations, respectively. When Gaussian fluctuations around the saddle point are taken 
into account, spin-quadrupole density waves with a linear dispersion are derived. Compared with the 
spin density waves in the half flUed spin-i Hubbard model, the quadrupole density wave velocity is 
saturated in the strong-coupling limit, and there are no transverse spin-quadrupole mode couplings, 
as required by the 80(4) invariance of the effective action. Finally, in the strong-coupling limit of 
the model Hamiltonian, we derive the effective hyperfine spin-exchange interactions for the Mott 
insulating phases in the quarter filled and half filled cases, respectively. 

PACS numbers: 71.10.Fd, 02.70.Ss 
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I. INTRODUCTION 



Ultracold atoms in optical lattices provide us with an 
ideal playground to study various interesting quantum 
phenomena and to explore novel many-body states with 
no counterparts in traditional solid state systems [l| . For 
alkali atoms, their hyperfine spin F is given by a combi- 
nation of the nuclear spin / and the electron spin S — ^, 
which has 2F + 1 manifold magnetic states. In mag- 
netic traps, these 2F + 1 components are split, while 
in optical traps these hyperfine spin degrees of freedom 
are degenerate and strong quantum fluctuations are dis- 
played. Depending on the value of the hyperfine spin F, 
one classifies ultracold atoms as bosons with integers and 
fermions with half integers. 

It has been well-established that ultracold bosonic 
atoms in optical lattices can exhibit a variety of novel 
phenomena, such as spinor Bose condensation @, H, 13, 111 j 
coherent spin dynamics 0, 0| and superfluid-Mott insu- 
lator quantum phase transition [1, . 

Meanwhile a degenerate F — ^ Fermi gas can be ob- 
tained by cooling alkali atoms ^'^^Cs, as well as alkaline- 
earth atoms ®Be, ^^^Ba, and ^'^^Ba. These high spin 
fermionic atoms in optical traps may lead to peculiar 
many-body ground states and exotic collective excita- 
tions, rarely appearing in interacting electron systems 
[13, Ei • For example, the Cooper pair structures in such 
high spin fermions are enriched: a kind of quintet pair- 
ing can be formed as an SO (5) polar condensate p^ . 
In one dimension, the competing S0(5) superfluid order 
has been investigated based on the bosonization tech- 
nique [H, and an exact Bethe-ansatz method 
has also been used to describe the corresponding low- 
energy states. Furthermore, a spin-3/2 ladder model has 



been proposed with spontaneous plaquette ground state 

Out of these intensive studies, Mott insulating states 
of ultracold atoms in optical lattices are of particular in- 
terest. With a fixed number of atoms on each lattice 
site, the quantum fluctuations of the hyperfine spin de- 
grees of freedom may lead to magnetic multipolar long- 
range order. Most previous studies focused on ultra- 
cold bosons with hyperfine spin F — 1,2. Adiabatically 
increasing optical lattice trap depth, these systems go 
through a quantum superfluid-Mott insulator phase tran- 
sition. The atomic virtual tunneling processes can result 
in effective hyperfine spin-exchange interactions between 
the nearest neighbor sites. In particular, an insulating 
spin-quadrupole or spin nematic ordering has been pro- 
posed for spin-1 bosons in optical lattices This 
is a quantum analogue of liquid crystal states, where the 
spin SU(2) rotational symmetry is broken while the time 
reversal symmetry is preserved fiol [20j. However, direct 
experimental observation of such a spin nematic ordering 
in correlated electron systems by conventional probes is 
rather difficult ^2l|. In this paper, we will demonstrate 
that such a novel quantum magnetic state also exists in 
the ultracold spin-| fermionic atoms in optical lattices, 
which may provide new opportunities for experimental 
investigations. 

In Sec. II, we will introduce the general spin-| Hub- 
bard model based on the microscopic s-wave atom-atom 
interactions. In Sec. HI a functional integral approach 
is applied to the half filled generalized Hubbard model 
when the s-wave scattering lengths for the total spin 
S = 2,0 satisfy conditions 02 > ao > 0. On a square 
lattice, the saddle-point solution gives rise to a stag- 
gered spin-quadrupole (nematic) ordered state with sym- 
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metry breaking from SO (5) to SO (4), and the corre- 
sponding spin and spin-quadrupole correlation functions 
will be evaluated. Moreover, by taking into account the 
Gaussian fluctuations around the saddle point, the spin- 
quadrupole (nematic) density waves are derived and the 
corresponding density wave velocity and stiffness are cal- 
culated. In Sec. IV, using the second-order perturbation 
theory in the strong-coupling limit of the model Hamilto- 
nian, we will derive the effective hyperfine spin-exchange 
interactions for the Mott insulating phases in the quarter 
filled and half filled cases, respectively. Finally, a sum- 
mary is presented in Sec. V. 

II. FORMULATION OF SPIN-| ONE-BAND 
HUBBARD MODEL 

In order to present our results in a self-contained way 
and to introduce notations, we first rewrite the funda- 
mental interactions between two hyperfine spin F = ^ 
fermion atoms with a contact potential [l^, El • For the 
low energy states of fermions, it is convenient to consider 
only the s-wave scattering, 

47r/i^ 

F(ri - ra) = (5(ri - r2)(ao7'o + aaT^a), (1) 

m 

where Vs projects the pair of atoms into states with total 
spin 5 = 0, 2 and is the s-wave scattering length in 
the spin-S channel. Due to antisymmetry of the wave 
function, the s-wave scattering of identical fermions in 
channels 5* = 1, 3 is not allowed. Using the relations 

ro+V2^ 1, Si-S2 - XoVo + X2V2, 

with Aq = —15/4 and A2 = —3/4, the interaction can be 
written in terms of spin operators 

Vin - rs) = S{ri - rs) {go + 92^1^2) , (2) 

where go ~ 7rfi,^(5a2 — ao)/m and (72 = 47r/i^(a2 — 
ao)/(3m). 

By introducing fermionic creation operators i/^Iq, for 
states in the lowest Bloch band on site i with spin compo- 
nents a — 3/2, 1/2, —1/2, —3/2, a generalized one-band 
Hubbard model can be written as: 

H ^ -tY, (v4^,a + H.c.) + ^Y. ^»(^' - 1) 

{ij),a i 

where the coupling parameters cq and C2 are proportional 
to go and 172, respectively, while their explicit expressions 
depend on the potential of optical traps and the atomic 
recoil energy. The total number of atoms on site i is 



and the total spin on site i is defined by 
with the spin-3/2 matrices 
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(4) 



These spin operators form an SU(2) Lie algebra 
[S°',Sf^] = ieafs^S'^. The first term in Eq. ^ de- 
scribes the nearest-neighbor hopping of fermionic atoms, 
the second term denotes the on-site Hubbard repulsion 
between atoms, while the third term represents the spin- 
dependent energy of the individual sites. When the s- 
wave scattering lengths for S* = and S = 2 are equal, 
the third term vanishes and the generalized one-band 
Hubbard model displays an SU(4) symmetry [HI, [l^]- In 
optical lattices, the atomic tunneling amplitude t can be 
easily tuned experimentally by varying the depth of op- 
tical traps. Using the Feshbach resonance, the scattering 
lengths ao and 02 can be varied, and the coupling pa- 
rameters Co and C2 can change over a wide parameter 
range. 

Moreover, for the spin-| fermion systems, the spin- 
quadrupole operators can be introduced as 
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where 

1 _ / 2.3.4 _f'f ^ \ r^-f ^ ^\ 

~ \il J' ~\0-aJ'^ ~\IOj' 

correspond to the five Dirac matrices, / is a 2 x 2 
unit matrix, and aa{a = x,y,z) are Pauli matrices. 



3 



The corresponding dipole and octupole operators can 
be expressed in terms of generators of the SO (5) Lie 
group as r'^'' = — |[r°,r'']. Thus, three spin opera- 
tors, five spin-quadrupole operators, together with seven 
spin-octupole operators, form the fifteen generators of 
the SU(4) Lie group. In terms of the Dirac matrices, 
the spin-quadrupole density operator is represented by a 
five-component vector 



a(3 



1,2,3,4,5). 



(6) 



Therefore, the generaHzed one-band Hubbard model for 
interacting spin-| fermions in optical lattices can be 
rewritten in an SO (5) invariant form pT| 

H ^ ^tY, (^Lv'.o + h.c.) ~^-fY.^n..f 

(ij),a i 

, 8co - 15c2 
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■Y,{N,~2Y^tj,Y,N,. (7) 



At half-filling, the chemical potential /i should be 
set to zero to ensure the particle-hole (p-h) symmetry: 
i^ia — > (~1) V1q,i ^J^d the average number of fermions 
per site should be {Ni) — 2. Thus, as far as the Mott in- 
sulating state is concerned, we can safely neglect the par- 
ticle number fluctuations focusing on the quantum spin 
fluctuations. In particular, for C2 > 0, the quantum spin- 
quadrupole fluctuations are an interesting feature of the 
spin-^ half filled Hubbard model in the Mott insulating 
phase. 



III. FUNCTIONAL INTEGRAL APPROACH TO 
HALF FILLED HUBBARD MODEL WITH ca > 

A. Saddle point solution 

It is known that the functional integral approach pro- 
vides a powerful tool for studying the antiferromagnetic 
ground state and spin density wave excitations of half 
filled spin-i Hubbard model HI HE HI- Following 
the same route, we will apply the functional integral ap- 
proach to the generalized spin-| Hubbard model at half 
filling. 

The partition function is written in an imaginary time 
functional path-integral form 



Z = 







- / L{T)dT 




Jo 



(8) 



where /3 1/T and the Lagrangian L is given by 
^ = J2i a V'L^T'V'm + H. In the following we denote 



U = 3C2/4 for simplicity and then an SO (5) invariant 
Hubbard-Stratonovich transformation can be performed, 



with 



drL (r) 



= E V'L^rV'.a - t J2 (V'L^ja + H.C.) 



i i,al3 



.pi^ip, (9) 



where a five-component real bosonic field 4>i{T) has been 
introduced. By integrating out the fermion fields and 
'0, we obtain an effective action 

rP 1 

^eff= / dTV-(/.,2(r)-Trln[a, + M]. (10) 
"'0 , ^ 



Here the trace is taken over the Nambu space, the spatial 
and imaginary time coordinates. The matrix element of 
M and fcrmionic Green's function (GF) are given by 



Ga^3{r^,T]YJ,T') 



1 



(r,;,T,a| 



(ri,T, Q;|M|rj,r',/3) = -2t5af35TT'5i^j+s 



|r,,T',/3), 



— 5rT'5i]$i{T) ■ Tap. (11) 



So far no approximations have been made. 

In order to reveal the consequences of the spin- 
quadrupole fluctuations, we first consider the saddle- 
point solution of the effective action. Differentiating S'oS 
with respect to 0° (r) , we obtain 



(t) 



2^ 

Q/3 



G„;3(r„r;r„r)r^„, (12) 



corresponding to a mean field result |ll[|. It is expected 
that the lowest energy state is given by a staggered phase 
of the SO (5) vector, namely, a staggered spin-quadrupole 
(spin nematic) ordered phase with an order parameter 
$i {''') ~^ |0|e*'^ '"'d , where d vector corresponds to one of 
the five spin-quadrupole components resulting from spon- 
taneous symmetry breaking of SO (5) to SO (4). On a two- 
dimensional (2D) square lattice Q = (tt, tt) corresponds 
to the reciprocal wave vector. Compared with the con- 
ventional magnetic long-range ordered states, there is no 
time reversal symmetry breaking in the spin-quadrupole 
ordering state. Then the effective action at the saddle 
point becomes 



4 




/ V/3(k,«w„) 
V V'/3(k- Q,iw„) 



where the summation over momentum is hmited to the 
reduced Brillouin zone, the dispersion relation is £k = 
—2t{coskx+ cosky), and a;„ is the fermionic Matsubara 
frequency. 

Due to the doubled unit cell, the fermion GF 

generally has to be defined as Ga/3(k, k';T) = 
— {TT'4'ka{T)'4>^_i^, lj{0)) , which has non-zero off-diagonal 
terms in momentum space due to the umklapp processes 
with respect to Q. Explicitly, the expression of the single- 
particle GF can be written as 



Gap (k, -k'-.iujn) 

{iu)n + £k) ^a/3<5kk' 



^|0|(r,^-(i)5k',k-Q 



El 



(14) 



where GF poles lead to the quasiparticle spectra = 
± 



+ At half filling, the upper band is empty 

while the lower band is completely filled. Thus an energy 



gap A = 2J^\4>\ opens up in the quasiparticle spectrum. 
By Fourier transformation, the gap equation is given by 
2U ^ 1 



1- 



El 



= 0. 



(15) 



At T = OK, for arbitrarily small U there is always a finite 
energy gap. Particularly, in the limit of f/ <C it gives 
rise to 



A ~ 2te~ 



/2t/U 



However, for U ^ t, we have A ~ 2U , i.e., the Mott gap 
in the single-particle excitations. 

Moreover, the sublattice spin-quadrupole moment is 
related to the energy gap and is given by 

^ (17) 



\ni\ 



■21 ' 



We have numerically calculated the energy gap and plot- 
ted the spin-quadrupole moment in Fig.l. For a large 
value of f/, A ~ 2U and |n,| 1, i.e., a saturated spin- 
quadrupole moment. 



B. Spin-quadrupole correlations at the saddle point 

The longitudinal and transverse spin-quadrupole cor- 
relation functions are defined as 

Xa(p,p';T) = -i(T,[np(r)-(i][n_p.(0)-rf]), 



X7r7r'(P,p';r) 



N 



(T,[np(T)-e„][n_p-(0)-e„-])(18) 




FIG. 1: The spin-quadrupole moment \ni\ 
the saddle point approximation. 



obtained in 



where d corresponds to the spin-quadrupole ordering 
direction, and e„ and e„' are unit vectors perpendic- 
ular to d vector. At the saddle point, the direc- 
tion of d and e„ does not change in time and space, 
and these correlation functions are expressed in terms 
of the single-particle GFs by using a Nambu spinor 

V'i = (V'i,3/2, V'i,i/2, V'i,-i/2,V'i,-3/2) • Actually, we no- 
tice that the transverse correlation X7r7r'(P5 p'; t) van- 
ishes when e„ _L e„' , and yields a finite value only when 
e„ = in' ■ Hence the correlation functions are written as 

(16) xAP,P';io^l) = E Tr[(r.d)G(k,-k';ia;„) 



X (r • d)G(k' -I- p', -k - p; iw„ + iui) 
X^{p,p';ioJi) = E Tr[(r-e„)G(k,-k';ia;„) 

X (r • e„)G(k' + p', -k - p; iw„ + iui)] 

After some straightforward algebra, the spin-quadrupole 
correlation functions are expressed as 



Xa(p,p';iw;) 

X7r(P,P';iWi) 



l^pp' x - l^n (t^n - gk£k-|-p T — 

kit {u>l + El) \{u,n + ivtf + El^^ 



(19) 



Performing the Matsubara frequency summation and an- 
alytical continuation, the imaginary part of x(P)P';w) 

can be derived. Since the off-diagonal terms in mo- 
mentum space vanish, we can only consider x(p,p;a;). 
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FIG. 2: (Color online) Longitudinal static spin-quadrupole 
structure factor So-(p) (a) and transverse static spin- 
quadrupole structure factor ^(p) (b) in the 2D staggered 
spin nematic ordered phase with U /t = 0.686 and A = 0.3. 
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To display the spatial correlations, the static spin- 
quadrupole structure factors are evaluated through the 
fluctuation-dissipation relation 5(p) = ^ j^"^ dijj[l + 
7iB(cL')]Imx(p, P; where nB{uj) is the Bose-Einstein 
distribution function. Ai T — OK, the static structure 
factors are obtained 



£k£k+p ± — ^ 



(20) 



The static spin-quadrupole structure factors are numer- 
ically calculated and displayed in Fig. 2, where broad 
peaks appear at p = (tt, tt), indicating antiferro- 
quadrupolar long-range correlations. 



C. Anisotropic spin fluctuations at the saddle point 

It is interesting to examine the spin-spin correlation 
functions in the presence of staggered spin-quadrupolar 
ordering background. Let us first look at the dipole mo- 
ment, 



{SI 



^ ^ Tr[5^G(k,Q-k; = 0, (21) 



f3N 



k,ic(j7i 



where S'^ (7 = x,y,z) denotes the corresponding spin-| 
matrices. This result implies that there is no spin-dipole 
long-range order in the saddle point solution. To get the 
collective excitations, the spin-correlation functions have 
to be evaluated, 

x"'^(p,p';r) = l(T.5^(r)5^p,(0)). (22) 

By expressing the spin-density operators in terms of 
Nambu spinor as = J2k,af3'^l+p,aSlf3^ki3, the spin- 
correlation functions are given by 



n(3 



{p,p';tu;i) = ^ Tr[5"G(k,-kVc.„) 



kk' ,tuj 

X S'^G{k' + p', -k - p; icj„ + loj. 



FIG. 3: The picture of the spin-quadrupole long-range or- 
dered state with the order parameter (— l)'n| on a two- 
dimensional square lattice, where each lattice site is occupied 
by a spin singlet state. 



Without loss of generality, we may assume the spin- 
quadrupole ordering is along d — 64. Then the order 
parameter is denoted by (— l)*(nf) 7^ 0, where 

(24) 

corresponding to the difference between the = ±3/2 
and — ±1/2 spin densities in the site singlet state. 
The physical picture corresponding to this particular 
spin-quadrupole ordering state is displayed in Fig. 3. In- 
serting the fermionic GF into the above expression of the 
spin correlations, we find that 

X^^(p, p'; ^u;l) = x'Hp, p'; ^ x'^iP, P'; (25) 

which implies that in the spin-quadrupole long-range or- 
dered state the time reversal symmetry is reserved but 
the spin rotational symmetry is broken. This is the main 
characteristics of the spin-quadrupole or spin nematic or- 
dered state. Thus the corresponding expressions of the 
spin-correlation functions are written as 



X 
5^. 



'■ip,p';iuji) 



f3N 



E 



(^n (w„ + UJi) — EkEk+p 



4 



(p,p';iwi) 



£'2 

^k+p 



(3N 



E 



5w„ {Un + W;) - 5ek£k-|-p ■ 



4 



El) 



K + ^/)^ + ^k+p 



(26) 



(27) 



It should be emphasized that unlike the half filled spin- 
^ Hubbard model [2^, all off-diagonal spin correlations 
in the momentum space vanish, which will be discussed 
in the next subsection. At T = QK^ we may rewrite 
x(p,p';ijj) = x(Pi^)^pp'; ^^^d the static spin structure 
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FIG. 4: (Color online) Static spin structure factor S^^(p) (a) 
and S'"' (p) (b) in 2D staggered spin nematic ordered phase 
with U/t = 0.686 and A = 0.3. 



factors can be derived as 



5£k£k+p ~ AV4 
-Bki?k+p 



). (28) 



We have plotted the corresponding numerical results 
in Fig. 4. For both S'^^(p) and (p), much broader 
peaks at the momentum (tTjTt) indicate the presence of 
strong antiferromagnetic fluctuations. The weaker broad 
peaks at (0, tt) and (tt, 0) show collinear spin-dimer cor- 
relations. Actually, these peculiar features of spin and 
spin-quadrupole structure factors can be detected by po- 
larized light Bragg scattering or spatial quantum noise 
interferometry experiments [27j|, which are reliable ex- 
perimental probes to detect magnetic correlations of ul- 
tracold atoms in optical lattices. 



D. Spin-quadrupole density waves 

To further study the spin-quadrupole collective exci- 
tation modes, we consider Gaussian fluctuations around 
the saddle point solution, = 0^ + f^^- Then, according 
to 

Trln[a^ + M] = Trln [-G-i(l - GV)] 

= Trln(-G-i) -V iTr(GV)"(29) 
^-^ n 

n 

the effective action ScS can be expanded as ^off = 
X^J^o ^^^^H4'c, 54>), where G represents the fermionic GF 
at the saddle point and the matrix element of V is given 
by 



{vi,T,a\Y\vj,T' ,13) = (5rT"5y V — • r^^. (30) 



Since V only contains a linear term in Scj), the above 
procedure is indeed an expansion in the spin-quadrupole 
fluctuation fleld 56. The flrst-order term in 5<b vanishes 



due to the saddle point condition. After some algebra, 
up to the second-order expansion, we arrive at 



pp' ,iuJi ab 



'iuji)6(l)'' (p, iw/) 



(31) 



where 



— ^ah<5p',-p + 



u 



J2 Tr[G(k,~k';zc^„) 



X r"G(k' - p', -k - p; iuj,, + ic^Or'] , (32) 

1 < a,b < 5 and are bosonic Matsubara frequencies. 
With the help of the following relations for the Dirac 
gamma matrices 

Trl = 4, TrF" = 0, 
Tr (F'^r'') = 4(5afc, Tr (r'^F''F") = 0, 
Tr (r'^F^'FT'^) = 4 {5ab5,d - SacSbd + SadSbc) , (33) 

the above kernel functions are expressed as 

K°^^{p, p', iuji) = [Kf) (p, iuji) 5ab+Ki (p, iuji) da^] V -P' 

with 

KQ{^,iui) = 1 - 2[/x7r(p,P;iw/), 

Xi(p,iw,) = 2C/[xa(p,P;«t^/) - X7r(p,P;it^i)]> (34) 

where Xcr(p, p; and x^(p, p; icj;) correspond to the 
spin-quadrupole correlation functions Eq. (|19p derived at 
the saddle-point approximation. 

Decomposing the spin-quadrupole fluctuation field 5(j) 
into one longitudinal component a parallel to the direc- 
tion d and four transverse components 7? perpendicular to 

the direction d, i.e., 5(f> = ('^^). In terms of a and tt, the 
effective action with Gaussian fluctuations is expressed 
as 

S^^\5$) = 5] i[ifo(p,*^z) + i^i(p,*c^O]k(P,*^/)l' 
+ Y.\ko{p,ioji)\^{p,iu:i)\\ (35) 



In the low energy limit ioji — > 0, for the momentum trans- 
fer p = Q, wc find (Q, 0) = and Ki (Q, 0) > fol- 
lowing from the quasiparticle gap equation. Hence the 
corresponding four transverse modes 7? are nothing but 
the Goldstone boson modes induced by the spontaneous 
symmetry breaking from SO (5) to SO (4), living on the 
space SO{b)/ SO{^) — S*^, while the a mode is gapful. 
Thus we identify these Goldstone collective excitation 
modes with spin-quadrupole density waves. 

For the spin-density wave (SDW) in the half filled spin- 
i Hubbard model, it had been noticed that the coupled 
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vibrations of S^ jci) and Sy (Q + q) produce the spin den- 
sity wave (28l . [29j . In the functional integral approach, 
up to the Gaussian fluctuations, the coupled transverse 
vibrations are generated and allowed by the symmetry 
breaking of SO (3) to SO (2) in the effective action [24, 2^, 
which is also the manifestation of an identity for Pauli 
matrices: Tr (^a°- a'^^ = 2ie°-^'^. Due to such coupled 
transverse vibration modes, the SDW velocity is strongly 
suppressed in the limit oi U ^ t, and there exist the 
off-diagonal transverse spin-correlation functions in the 
momentum space. To the contrary, we have found that 
the transverse mode couplings in spin-quadrupole density 
waves are absent, because the S0(4) invariance of the ef- 
fective action under the Gaussian fluctuations does not 
allow such couplings. This is also the consequence of an 
identity for the Dirac gamma matrices: Tr(r'^r'T'=) = 0. 
Actually, the same reason leads to vanishing of the off- 
diagonal terms of the transverse spin-quadrupole density 
correlations in the momentum space, as pointed out in 
the last subsection. The absence of the transverse spin- 
quadrupole density wave mode coupling is a remarkable 
property of the enlarged hyperfine spin space dimension- 
ality and the higher symmetry of the local interactions 
in the generalized Hubbard model. 

In order to evaluate the spin-quadrupole density wave 
velocity, we perform the Matsubara frequency summa- 
tion of Kf) (Q + q, Lo) and analytical continuation, where 
q is small and cj ^ 0. At T = 0, Ki^ (Q + q, lo) is ex- 
panded up to the second order in q and oj, namely. 



-^o(Q + q, a;) w aq^ — buj'^ 



with 



N ^ 

k 



^ sin^ kx 



6 = 



(36) 



(37) 



Thus, the effective action of vf mode can be expressed as 
1 [ dqduj 



5(2) (7?) 



■ LO 



|7r(q,u;) 



(38) 



with spin-quadrupole density wave stiffness p = b and 
velocity Vg = \J ajb. The corresponding numerical re- 
sults are shown in Fig. 5. In the small IJ limit, the spin- 
quadrupole wave velocity is approximated by 



Vtt t 

while in the large V limit it is given by 
z;,«V2t(l + ^). 



(39) 



(40) 



Due to the absence of the coupled vibrations of the trans- 
verse modes, the spin-quadrupole density wave velocity is 
saturated in the strong coupling limit, in a sharp contrast 
to the spin-i^ case. These properties are based on the 
symmetry consideration. Therefore, the above results ob- 
tained in the Gaussian approximation around the saddle 




FIG. 5: Spin-quadrupole density wave velocity Vs (solid line) 
compared with the spin density wave velocity vsdw (dashed 
line) (a) and stiffness p (b) in 2D for the staggered spin ne- 
matic phase. We choose an 2U on-site interaction in the Hub- 
bard model to obtain the same gap equation as for our spin- 
quadrupole ordered phase. 



point should be valid even in the presence of higher-order 
fluctuations. 

Below T ~ A, the single-particle excitations are 
gapped, and the only contributions to the entropy are due 
to spin-quadrupole density waves with a linear disper- 
sion. On a 2D square lattice, the thermal energy per unit 
volume is easily calculated as E/T !v 4:.8{kBT)'^/ {-kH^vI). 
When measuring the low temperature special heat, we 
expect that c ^ T^, from which Vg can be determined. 
We would like to mention that such a quadratic tem- 
perature dependence of the specific heat is consistent 
with recent experiments on Ni2Ga2S4 (soj . a rare exam- 
ple which, probably, has a spin-quadrupole long-range 
ordered ground state [sil, [sl, [sl] . 



IV. EFFECTIVE HYPERFINE 
SPIN-EXCHANGE INTERACTIONS OF THE 
MOTT STATES 



So far, a functional integral approach has been devel- 
oped to consider the generalized half filled spin-| Hub- 
bard model, and we have obtained a number of inter- 
esting results. In this Section, we derive the low-energy 
effective hyperfine spin model Hamiltonian in the strong- 
coupling limit. In the Mott insulating state with a small, 
but finite atomic tunneling parameter, the virtual tunnel- 
ing of ultracold atoms can induce effective spin-exchange 
interactions between the nearest neighbor sites, leading 
to possible magnetic multipolar ordering or disordered 
states. In order to derive such interactions, we have to 
carefully consider the strong coupling limit and perform 
the second-order perturbation calculation. 



A. Single lattice site 

Let us first look at the extreme limit of i = 0. Each 
lattice site decouples from its nearest neighbor sites, and 



8 



the single site Hamiltonian is obtained 



Co 



C2 , 



15 



Ho^^NiN-l) + ^{S'--N) 



(41) 



The corresponding energy eigenstates labelled by 
\n, S, m) with good quantum numbers n, S and its z com- 
ponent m are given by 



i?o = |n(n-l) + |U5+l)-^n 



(42) 



which has 25*+ 1-fold degeneracy. According to the Pauli 
principle, we can construct the eigenstates with zero and 
even number of particles as 



|0,0,0) 
|2,0,0) 

|2,2,0) 
|2,2,2) 
|2,2,1) 
|4,0,0) 



1 

1 

71 



t „/,t 



t,/,t 



|2,2,-2> = Vli^l3 |^^>, 

2 2 2 2 

i;U\ |r!), |2,2,-1) =V'lV'l3 

2 2 2 2 

V'lVtV'liV'la (43) 



while the eigenstates with odd number of particles are 
given by 



1 ^ ^ 

' 2' 2 

' 2 2 



^'2' 2 
' 2' 2 
^'2' 2 



2 



3 3 
' 2' 2 



1, 



1 



V't -01 "0!. 



2' 2 

2 2 2 
2 2 2 

2 2 2 



2 



(44) 



Here it is worth noticing that the number of the possi- 
ble eigenstates are substantially reduced by the Pauli ex- 
clusive principle. The corresponding eigen-energies are 
listed in Table dJ). 

From the experimental point of view, the Mott insulat- 
ing states with one or two particles per site are the most 
interesting cases because they are free of three-body de- 
cays. 



B. One atom per site 

To derive the effective model Hamiltonian, we can 
simply consider a two-site problem. For one atom 



TABLE L Eigenvalues of the single-site model Hamiltonian. 



Particle number n 



Total spin S 



Energy Eq 




3/2 



2 
3/2 








Co - xC2 

Co - |C2 
3C0 - f C2 

4c2 



6co 



per site, the unperturbed ground state will be given 



by |l,3/2,m,)(^)|l,3/2,m,y^^ 
states are allowed: 



Then, four intermediate 



|17)«|2,0,0) 



and i 
and i 



(45) 



J, 
j- 

Since the tunneling processes of Ht = 
~*Sct(V'iLV'ia+H.c.) conserve the total spin S — Si-I-S^-, 
the total magnetic quantum number m — mj 4- rru , 
and the total number of particles n = Ui -\- Uj [ITI . |3J] , 
the energy shifts of the total spin-S' channel from the 
second-order perturbation theory can be calculated as 



{v\ Ht \n,S, to) 

E,, — En 



(46) 



where |n, S*, to) and \v) denote the initial state and the 
possible intermediate states in the representation of the 
two-site system, respectively. The total number of par- 
ticles 71, the total spin S, and its z component are 
good quantum numbers, while E^ and Eg correspond to 
the zeroth-order eigenenergies of these states, which are 
calculated from the single-site eigenenergies in the Ta- 
ble I. According to the allowed intermediate states, the 
channels with total spin S — Q and S — 2 have to be 
considered in this case. 

For the energy shift in the total spin S — channel, 
there are two possible intermediate states: Si = 0, Ui = 



0; 5, 



0, rij = 2 and i ^ j. 



With the help of the 



Clebsch- Gordon coefficients, the unperturbed state and 
intermediate states are expressed in the form 



|2,0,0) = i 



3 3\('^ 
' 2' 2/ 



^' 2' 2 



3 _3 \ 
'2' 2/ 

^' 2' 2/ 



l^i 

' 2' 2 



1, 



(0 



'2' 2/ 



|2,0,0)i„t = |^^)(*)|2,0,0)^^^ andi^j. 
Thus the corresponding energy shift is evaluated as 



\{J) 



1, 



3 1 



0) 



0)^ 



4co — 15c2 



(47) 
(48) 
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Then let us consider the total spin S = 2 channel. 
There are two possible intermediate states Si — 0, rii = 0, 
Sj = 2, Tij = 2 and i ^ j. We notice that evaluation of 
the energy shift with maximal spin projection to = is 
sufficient for obtaining the needed results, because the 
tunneling Hamiltonian is SU(2) spin invariant and the 
tunneling processes do not mix the different mp states. 
In the representation of the two-site system with good 
quantum numbers, the unperturbed state and interme- 
diate states with maximal spin polarization are written 
as 



1 

71 



3 3 
' 2' 2 

3 1 
2' 2 



1 

' 2' 2/ 



(i) 



1, 



|2,2,2)j„, = |f^)«|2,2,2) 



(i) 



3 3\ 
2' 2/ 

and i -f- 



U) 



J- (49) 



Similar calculation leads to the energy shift in the total 
spin S = 2 channel as 



62 



4cn - 3c2 



(50) 



Thus, up to the second order of the hopping term, 
the effective spin-exchange interactions for the two-site 
problem are obtained as 



-eo^y (0) + e27'y(2). 



(51) 



where 'Pij{S) projects the two-spin states of Si — Sj ~ 
3/2 onto the total spin-S* state. The explicit form of 
Pij{S) are given as follows: 



^y(O) 



(Si'Sj — Ai) {Si-Sj — A2) (Si'Sj — A3) 
(Ao- Ai)(Ao-A2)(Ao-A3) ' 



-ry (o\ _ (Sj-Sj - Aq) (S.t-Sj - Ai) jSi-Sj - A3) ^^^^ 
''^ ^ ~ (A2-Ao)(A2-Ai)(A2-A3) '^^'^ 

with A5 = i [S{S + 1) - ^] • For the lattice model, the 
effective spin-exchange interactions is finally obtained up 
to a constant 



(53) 



here we have eo = £2 = — Then the effective spin- 
exchange interaction becomes 



Heff^ Y.i'^^M+'Pvm, (54) 



with 



7',,(0)-fP.,(2) 

1 q 11 o 9 99 

= — (S,-S,) (SrS,)^ + — S,-S, + —.(55) 

9 V * 36 ^ 16 ^ 64 ^ ^ 

This effective spin model also exhibits a uniform SU(4) 
symmetry. In one dimension, an exact solution had 
been obtained by the Bethe ansatz method 35], and 
the ground state of the SU(4) spin-exchange model is 
a spin singlet with gapless spin excitations. Moreover, 
such a spin- 1 exchange Hamiltonian is equivalent to the 
so-called SU(4) spin-orbital model, which has been ex- 
tensively studied in solid-state systems [36l |. 



C. Two atoms per site 

More interesting and complicated situations occur for a 
Mott insulator with two interacting atoms per site. Now 
the possible ground states on each site may depend on 
the spin dependent coupling parameter C2. In the limit 
of t = 0, the single site state is a spin singlet {Si = 0) for 
C2 > and a spin quintet {Si = 2) for C2 < 0. However, 
a small finite tunneling induces an exchange energy of 
order P /cq between the nearest neighbor sites. Since the 
energy difference between the spin singlet and quintet 
states is given by C2, when t^/co is large compared with 
the absolute value of C2, the quintet state is mixed with 
the singlet state, and both spin configurations of these 
two states have to be taken into account in the second- 
order perturbation calculations. However, in the present 
section we will not consider this situation and simply 
assume t ^ -y/ co|c2|. The discussion is divided into two 
parts. 



<ij> 



Actually, a similar effective hyperfine spin model Hamil- 
tonian was also given in the earlier work [l^. Here we 
would emphasize that the validity of the second-order 
perturbation theory is restricted to cq 3> i to ensure the 
stability of the Mott insulating state. When t becomes 
large and comparable to the energy difference between 
unperturbed ground state and the lowest intermediate 
states, higher-order perturbations should be included, 
and the spin exchange beyond the nearest neighbor sites 
should be considered. 

In particular, when C2 = 0, the original spiii- 1 Hub- 
bard model displays an SU(4) symmetry [ll|, l22|, and 



1. C2 > 

In this case, the two-site unperturbed ground state cor- 
responds to the site singlet state |2, 0, 0)^*^ |2, 0, 0)^''\ and 
the allowed intermediate states are 



T 3 

1 , — , TO ., 

' 2 



(0 



and i ■ 



(56) 



According to the initial state, only the total spin 5' = 
channel is involved. The two-site unperturbed and inter- 
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mediate states are expressed as 



written as 



|4,0,0) 
|4,0,0)i„, 



|2,0,0)(*^ |2,0,0)(^'^ , 



3 3 
' 2' 2 



„ 3 __3\(^) 
^'2' 2/ 



3 3 
' 2' 2 

l^i 

' 2' 2 

1^-1 
' 2' 2 



(0 



, 3 3\« 
'^'2'2/ 

3 ^ 

^'2' 2/ 



3 1\ 
2' 2/ 



(i) 



(57) 



and the corresponding intermediate state with i <-> j. 
After some algebra, the energy shift is calculated as 



|4,3,3) = -^|2,2,2)(*)|2,2,1)^''^ 



-^|2,2,1)«|2,2,2)(^\ 



|4,2,2) = 



^|2,2,2)«|2,2,0) 



+ ^/^|2,2,0)«|2,2,2)(-'") 



0) 



^|2,2,1)«|2,2,1)(-'") 



|4,1,1) = -^|2,2,2)«|2,2,-1)(^') 
--i=|2,2,-l)«|2,2,2)(^) 

'^|2,2,1)«|2,2,0)(^') 



4co + 15c2 



(58) 



Then, up to a constant, the effective lattice model is ob- 
tained as 



^eff - 



4co + 15c2 



(59) 



2,2,0)«|2,2,1 



S3) 



|4,0,0) = -^|2,2,2)«|2,2,-2)(^') 
+ -i=|2,2,0)(*)|2,2,0)(^') 
-i=|2,2,-l)«|2,2,l)(^-) 
--i=|2,2,l)«|2,2,-l)(^) 
+ -^|2,2,-2)«|2,2,2)(^') 



(60) 



where 'Pij(O) is the singlet projection operator between 
two site singlet states, which can not be expressed in 
terms of powers of hyperfine spin exchanges. In this 
sense, the functional integral approach developed in Sec. 
Ill is a more appropriate method to attack this problem. 



2. C2 < 



In this case the two-site unperturbed ground state is 
described by the quintet state |2, 2, mi)'-*'' |2, 2, mj)^-'-'. 
Two intermediate states have been given in (j56p , but the 
total spin S = 0, 1, 2, 3 channels have to be considered, 
as the virtual tunneling process is forbidden in the 8 = 4, 
channel due to the Pauli's exclusion principle. With the 
help of the Clebsch-Gordon coefficients, the unperturbed 
two-site ground states with maximal spin polarization are 



The intermediate states in total spin S = Q channel 
have been expressed as (157^ . while the other intermediate 
states in channel S* = 3, 2, 1 are expressed as 



|4,3,3). 
|4,2,2), 



|4,l,l)int 



1,. 
1 

V2 



3 3 



3 3\ 



(i) 



' 2' 2 



1 

10 

/2 



2' 2 
, 3 3 



l^i 

' 2' 2 



2' 2/ ' 

'^'2'2/ 

, 3 3\(^-) 
^'2'2/ 



(0 



(i) 



3, 



3 1 

2'~2 



U) 



3^1 
^'2' 2 



0) 



1^-i 
' 2' 2 



.(61) 



and corresponding intermediate states with interchange 
i ^ j- It is sufficient to calculate the energy shifts with 



11 



these maximal spin polarized states. The final results are 
obtained as 



4co - 9c2 



£3 — 7^0, £2 
5 



0. 



(62) 



Note that up to the second order of t, the total spin 
S — 2 channel makes no contribution to the energy shift. 
Hence, the resulting effective spin interaction for the lat- 



tice model reads up to a constant 



Heff = eoJ2 {'P^^ (0) + I [^*^- (1) + (3)] I ' (63) 

<ij> ^ 



where Vij{S) projects the Si = S'j = 2 states onto the 
total spin-S" states. They are given by 



(S,;-Sj — Ai) (Si'Sj — A2) (Si'Sj — A3) (S,;-Sj — A4) 

(Ao - Ai) (Ao - A2) (Ao - A3) (Ao - A4) 
(Si'Sj — Aq) (Si'Sj — A2) (Si'Sj — A3) (Si'Sj — A4) 

(Ai - Ao) (Ai - A2) (Ai - A3) (Ai - A4) 
(Si'Sj — Ao) (Si'Sj — Ai) (S,:-Sj — A2) (Si'Sj — A4) 

(A3 - Ao) (A3 - Ai) (A3 - A2) (A3 - A4) 



with As = i [5(5+ 1) - 12]. Moreover, the effective 
spin-exchange model Hamiltonian can be simply written 
as 



Heff = 



fo 
' 6 



E 

<ji> 



1 32 2 

Si'Sj) + — (Si'Sj) — Si'Sj 

1 o 



15 



(65) 

Here we would like to emphasize that the spin operators 
correspond to 5 = 2 operators. 



V. CONCLUDING REMARKS 

To summarize, a functional integral approach has been 
applied to study the quantum spin-quadrupole long- 
range ordered state of the Mott insulating phase in the 
generalized half filled spin-| Hubbard model for the 
case 02 > flo > 0. On a square lattice, the ground 
state shows a staggered spin-quadrupole long-range or- 
der from the saddle-point solution of the effective ac- 
tion. By including the Gaussian fluctuations, the four 
gapless collective modes have been found, corresponding 



to the spin-quadrupole density waves. Unlike spin den- 
sity waves in the half filled spin-^ Hubbard model, the 
spin-quadrupole density wave velocity is saturated in the 
limit of 02 ^ ao I because the transverse mode couplings 
of the spin-quadrupole collective excitations are not al- 
lowed by the S0(4) invariant effective action. Thus, our 
results obtained under the Gaussian approximation for 
the spin-quadrupole ordered state are robust even when 
the high order fiuctuations are included. This is a re- 
markable property of the enlarged hyperfine spin space 
dimensionality and the higher symmetry of the local in- 
teractions in the generalized spin-| Hubbard model. 

Moreover, the effective hyperfine spin-exchange inter- 
actions for the quarter filled and half filled cases have 
been derived from the second-order perturbation theory. 
Starting from these effective spin-exchange interactions, 
more efficient treatments may be carried out to charac- 
terize these multipolar magnetic states. Further investi- 
gations in this regard will be reported elsewhere. 
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